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Abstract 

Traffic on a circular road is described by dynamic programming equations associated to optimal 
control problems. By solving the equations analytically, we derive the relation between the average 
car density and the average car flow, known as the fundamental diagram of traffic. First, we present 
a model based on min-plus algebra, then we extend it to a stochastic dynamic programming model, 
then to a stochastic game model. The average car flow is derived as the average cost per time unit 
of optimal control problems, obtained in terms of the average car density. The models presented 
in this article can also be seen as developed versions of the car-following model. The derivations 
proposed here can be used to approximate, understand and interprete fundamental diagrams 
derived from real measurements. 

Keywords: fundamental diagram of traffic, traffic phases, optimal control, min-plus algebra. 

1 Introduction 

The relation between the car density and the car flow in road traffic systems is known under the 
name of fundamental diagram of traffic. Basically, fundamental diagrams are studied on one road (a 
urban road, a highway segment or a circular ring) [3U1 EJ 131 1301 1221 13 [213 [TOj • In this case of one 
road without crossing, one talks about fundamental diagram of one dimensional traffic (ID-traffic). 
However, many works on fundamental diagrams of 2D-traffic (roads with crossings) have appeared 
recently [27l [12l El [13l [14l [17l El HH1 HOI SI [23]. We are intereseted in this article by fundamental dia- 
grams of ID-traffic. We present an optimal control approach that permits to understand, approximate 
and interpret ID-diagrams. 

The relation flow-density have been observed on a highway since 1935 by Greenshields [20) . 
Lighthill, Whitham, and Richards (LWR) <26 :i :28^ describe the traffic by a car conservation equa- 
tion d t o~ + d x p — 0, where o~(x,t) and p(x, t) denote respectively the density and the flow of vehicles 
in position x at time t. In the stationary regime, the flow p is linked to the density a by the following 
functional relation: p(o~) = dv, where v is the average car-speed. To complete the dynamics given by 
the car conservation equation, LWR supposed the existence of a traffic behavior equation p = f(cr), 
either in the situation of time and space dependence, called the fundamental diagram of traffic. 



A well-known microscopic model is the car- following model [211 US] . The traffic is described on 
one road where it is supposed that vehicles follow their predecessors without overtaking and with a 
stimulation-response relation. In [8 , Daganzo and Gerolimins used a variational theory [5J Q~71 [T5] to 
show the existence of a concave macroscopic fundamental diagram on a ring Q Our results are very 
close to those given in [8]. However, the approaches, the models, and the exploitation of the results 
arc very different. 

In this article, the traffic on a circular road (ring) is described by dynamic programming equations 
(DPE) of optimal control problems. The average car flow is derived as the average cost per time unit 
of the optimal control problem considered. In addition, the average car flow is given in term of the 
average car density, giving thus the fundamental diagram of traffic. The models we present here lead 
to piecewise linear diagrams. 

We consider n vehicles moving on a one-lane circular road without overtaking. We start with 
a very simple model (the min-plus model) witch we extend by refining the traffic description. The 
min-plus [^] linear model describes the traffic using two parameters: a desired velocity v, fixed and 
common for all vehicles, and a safety distance a between two successive vehicles. The dynamics tells 
simply that at each time, each car tries to move with a velocity v under the constraint that it has to 
leave a safety distance a with respect to the car ahead. The dynamics are given by a min-plus hear 
system |^] and the average car flow is derived as the min-plus eigenvalue of this system. 

We extend the min-plus model by assuming that the desired car velocities are not constant but 
depend on the distances between successive cars. The first extension gives a model that describes 
the traffic by a DPE of a stochastic optimal control problem. We solve analytically this equation 
and get the fundamental traffic diagram. This extension permits to realize a large class of cancave 
fundamental diagrams. The second extension gives a model that describes the traffic by a DPE of 
a stochastic game problem with two players. Similarly, we solve analytically the DPE and get the 
fundamental traffic diagram. This latter extension permits to realize even non concave diagrams. 

2 Min-plus Traffic Model 

We present in this section the first model which we call the min-plus traffic model. It is a very basic 
model, presented mainly to introduce its extensions. This model is a dual version of the min-plus 
model studies in |25j . Let us first give a short review of the min-plus algebra. Min-plus algebra [2] is 
the commutative idempotent semiring (K U {+oo},©, ®) where the operations ® and <£> are defined 
by a ® b = min(a,6) and a <g) b = a + b respectively. We denote this structure by K m i n . The 
zero and the unity elements are repectively +00 denoted e and denoted e. The main differences 
between standard and min-plus algebras are the idempotency (a © a = a, Va 6 Kmin) and the non 
simplification (a(Bb = a(Bc=frb = c) of min-plus addition. The structure K m i n on scalars induces 
another idempotent semiring on the set of square matrices with entries in ]R m i n . If A and B are two 
square matrices with entries in K m i n (we say min-plus square matrices), then the addition is defined 
by: (A ® B) tJ = A tJ B t j, Vi, j, and the product by : (A(g> B)^ = ® k {A ik ® B kj ), Vi, j. The zero 

lr This approach has been extended, in the same article 0, to a network, by using an aggregation method. 
2 A short review in min-plus algebra is given in section 2 

3 which can be seen as a dynamic programming equation of a deterministic optimal control problem. 
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and the unity matrices are also denoted by s and e respectively. A directed graph G(A) is associated 
to a square min-plus matrix A. It is the graph whose nodes correspond to the matrix lines and whose 
arcs correspond to the no null e) entries of A. When Aij =^ e, there exists an arc in Q{A) going 
from node j to node i. 

Theorem 1. JE/ If the graph Q{A) associated to a min-plus square matrix A is strongly connected, 
then A admits a unique min-plus eigenvalue \x given by the minimum of the average weights of the 
graph circuits: \x = min c6 c(|c| TO /|c|/), where C is the set of the circuits in Q{A), \c\ w is the weight of a 
circuit c given by the min-plus product (standard sum) of the arc weights, and \c\i is the circuit length 
given by the number of arcs of the circuit. 

Theorem 2. JEJ The min-plus linear dynamic system associated to a square min-plus matrix A whose 
graph is strongly connected, defined by: x k+1 = A (£) x k , is asymptotically periodic: 3T,K,fi : Vfc > 
K : A k+T = fi T <E> A k . Moreover, pi coincides with the unique eigenvalue of A. 

2.1 The model 

We assume here that all cars have one length, and we take this length as the unity of distance. We 
consider n car moving on a one-lane circular road of length m (the road cannot contain more than m 
cars), with n < m; see Figure [I] The car density on the road is n/m. We assume that the cars have 
one same desired velocity v and that each car has to respect a safety distance a with respect to the 
car ahead. 




Figure 1: Traffic on a circular road. 



Let us denote by x k the distance travelled by a car i up to time k. This distance satisfies the 
following dynamics: 

x k+i = I min{« + x k , x k i+1 - a} if i < n, 

I min{i> + x k , x k + m — cr} if i = n. 

The average growth rate per time unit of system ([I]) is interpreted as the average car velocity on the 
road. This system is written in min-plus algebra as follows : 



x k+1 



v (g) x\ © (e/cr) ® x k +1 if i < n, 
v S3 x k © (m/cr) <g> x\ if i = n, 



where the symbol / denotes the standard substraction. For example, e/cr is nothing but (— a) in 
standard algebra. The dynamics ^ is min-plus linear and can be written : 

x k+1 =A®x k , (3) 
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where A is a min-plus matrix given by : 



A = 



v efa e 
e v efa 



£ £ £ 

mfa £ e 



efa 
v 



Theorem 3. \25\/ There exists an average car velocity v. It is the eigenvalue of the matrix A associated 
to system and is given by : v — min{v, (to — na)/n\. 

Proof. The graph associated to the min-plus matrix A is shown on Figure [2} Theorem [1] gives the 




Figure 2: The graph associated to A. 



eigenvalue of A as the minimum of the average weights of the circuits of the graph associated to A. 
The elementary circuits of the graph of Figure [2] are : 

• the circuit passing by all the nodes, with an average weight of (to — na)/n, 

• the loops of weight v. 

Thus we obtain v. The average growth rate per time unit of system ^ is interpreted as the average 
car speed on the road. Using Theorem [2j we conclude that the average car speed is the eigenvalue v 
of A. □ 

Corollary 1. [25 1 The fundamental traffic diagram on a circular road where the traffic is described 
by the dynamics is : f = min{vd, 1 — ad}. 

Proof. We know that the average car flow / is given by the average car speed v multiplied by the car 
density d : f = dv. By replacing v by its value given in Theorem [3j we obtain the result. □ 



3 Stochastic optimal control model 

In this section, we extend the min-plus traffic model given in the preceding section. We assume here 
that each car chooses its desired velocity depending on the distance with respect to the car ahead. 
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The car dynamics will be written as a dynamic programming equation of a stochastic optimal control 
problem. The fundamental traffic diagram is then derived by solving this equation. The extension we 
give in this section permits to approximate a large class of emphconcave fundamental diagrams. 

In order to clarify the modeling context and to set notations, let us give a short review on stochas- 
tic optimal control of Markov chains. A stochastic optimal control problem in finite horizon with 
undiscounted costs is written as follows (see for example [31]) : 

niinEJ lim ~ V c u l 1 (4) 
ses 1 t^+oo T ^ x \ 

where (x k )keN is a controlled Markov chain with a finite set of states X = {1, 2, • • • , n}, u k £ U is 
the decision variable taken at time k, with U a finite set of controls, c^ k £ R is the cost to pay at 
time k being in x k and taking the decision u k , and S is the set of control strategies, that is the set of 
time-indexed sequences in U (a strategy s £ S is a fixed sequence {u k }ken, u k £ U) Q 

If we denote by M u ,u £ U, the transition matrix of the Markov chain associated to a control 
U £lA, then the stochastic dynamic programming equation associated to problem Q is written : 

fi + Vx = mm{[M u v] x + c^}, Vl<x<n, (5) 

u&A 

In (§, yU can be seen as an additive eigenvalue associated to the eigenvector v of an operator h : R n 9 
v H> h(v) £ R" defined by: 

h x (v) = mm{[M u v) x + c x }, Vl<i<n. (6) 

Operator h given in ^ is additive 1-homogeneous (that is h{p + v) = \x + h(v), V fj, £ K., V v £ K n ), 
monotone (Vv,w £ R n , [v x <w x , Vi] =5- [h x (v) < h x (w), Vx]) and concave (\fv,w £ R™, Vt £ 
[0, l],h(tv + (1 - t)w) > th(v) + (1 - t)h(w)). 

Let us define, as in [16] . an oriented graph G(h) associated to an additive 1-homogeneous and 
monotone map h by the graph of n nodes where arcs are determined as follows: there exists an arc 
from i to j if lim v ^ roa j j[yei) ~ oo, where e ; denotes the i th vector of the canonic basis of W 1 . We 
denote by x(h) t ne average growth rate per time unit of the dynamical system: v k+1 — h(v k ), defined 
by: x{h) — lina&_>oo v /k. In the following, we recall an important result on additive 1-homogeneous 
and monotone maps. 

Theorem 4. ]21l \15jl If h is an additive 1-homogeneous and monotone map, and if Q(h) is strongly 
connected, then the additive eigenvalue problem ji + v = h(v) admits a solution (/i,f), where v is 
defined up to an additive constant, not necessarily in a unique way, and /i is unique and satisfies 
X(h) = '(/x,M, • • • , AO- 
Corollary 2. Let h be the operator defined in |(|). IfQ(h) is strongly connected, then the eigenvalue 
problem admits a solution (fi, v) where v is defined up to an additive constant, not necessarily in 
a unique way, and fi is unique and satisfies x(^) = (/•*> " • • > A 4 )- 

4 It is known that solving optimization problem |3| in S is equivalent to solve the same problem in V C S, where 
V is the set of feedback strategies defined on X. A feedback p associates to each state x 6 X a control u 6 U 
(V 3 p : X 3 x M> u £ U). 
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3.1 The model 

As above, we suppose n vehicles moving on a circular road of length m, with n < m. Let us denote 
by y k the distance travelled by a given vehicle up to time k and by z k the distance travelled by the 
vehicle ahead up to time k. We add to the two constraints of velocity limitation and safety distance, 
another constraint which expresses the dependence of the velocity at time k on the distance z k — y k . 
Thus we obtain three constraints : 



• Velocity limitation: 

• Safety distance: 



y k+1 <y k + v 



y k+l <z k -a 



Dependence of the velocity on the distance z k — y k : 

y k+1 <y k + P(z k -y k ), < < l 



These three constraints can be summarized in: 

y k+1 <y k + a + P(z k -y k ), < f3 < 1 . 



(7) 



Indeed, the first constraint is obtained by taking a = v, and /3 — 0, the second one by taking a = —a, 
and P = 1, and the third one by taking a — 0. In general, we assume that each vehicle has to satisfy 
a set U of traffic constraints of type Q. With n vehicles indexed by i, moving on a road of length m 
(the car density is d = n/m), we denote by x\ the distance travelled by a vehicle % up to time k. The 
car dynamics is then written as follows : 



voxa^ m {x\ + a u + P u {x k +X - x k )} if i < n, 
min uf z U {x k + a u + p u (m + x k - x k )} if i = n, 



and since m = n/d^ we obtain : 



x k+1 = 



iu&/{a u + (1 - Pu)x k + P u x k +1 } 



if i < 



n. 



min ueW {a„ + n(3 u /d+ (1 - f3 u )x k + P u x k } if i = n. 
Let us define the matrices M" and the vectors c u for u € U by : 



i - A. A. o 

o i - A* A, 

o 

, At o 



i-A. 
o 



o 




A. 

l-/3«. 



(8) 



(9) 



5 The case d = is trivial since it corresponds to n = 0. This case is implicitly neglected here. 
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c u = f [a u , a u , ■■■ , a u , a u + nfi u /d}. 
Equations ([9| are then written : 



x k+1 = mm{[M u x% + c* 1 }, 1 < % < n . (10) 



System ( 10 ) is a backward dynamic programming equation of a stochastic optimal control problem of 
a Markov chain with transition matrices M u , u £lA and costs c u , u gW. 

Let us denote by h the operator giving the dynamics (flOf, that is h : W 1 — > R™ given by : 



hi(x k ) = min{[M u x% + c* 1 }, l<i<n. 

Proposition 1. The graph G(h) associated to h is strongly connected if and only if there exists u G U 
such that j3 u ^ (that is /3 U € (0, 1]). 

Proof. 

• If 3u <G U, such that f3 u £ (0, 1], then for all 1 < i < n, there exists an arc on Q{h) going from 
i + 1 to i (modulo n). Indeed, we have: 

x\ +l = (1 - p u )x% + P u x k l+1 + a u , 

and since (i u > 0, we get: 

lim hi(ve l+ i) = lim \f) u v + a u ] = oo. 

v— >-oo v— foo 

where e^+i denotes the (i + l) th vector of the canonic basis of R n . Thus the graph G(h) is 
strongly connected. 

• If Vu £ U, (3 U = 0, then we can easily check that all arcs of G(h) are loops; so the graphe G(h) 
is not strongly connected. □ 

In the following, we suppose that there exists u in U such that f3 u £ (0,1]. In terms of traffic, 
this means that each car moves by taking into account the position of the car ahead. With this 
assumption, we get an additively 1-homogeneous and monotone operator h, whose associated graph 
is strongly connected. 

Applying Corollary [5] we conclude that the system : 

H + x l =min{(M u x)i + c^}, l<i<n (11) 

admits a solution (/i, x) where x is defined up to an additive constant, not necessarily in a unique way, 
and fi is unique and satisfies : 

/i = lim \x k , l<i<n. (12) 
fi is interpreted as the average speed of cars. 



Theorem 5. System (11) admits a solution {n,x) given by: 

li = mm{a u + ~] and a; = *[0 l/d 2/d ■•• (n-l)/d\. 

u&A d 
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Proof. It is natural to think that the asymptotic positions Xi, 1 < i < n are uniformly distributed 
on the ring. This gives the eigenvector x. It is also natural to think that the optimal strategy is 
independent on the state x, because of the symmetry of the system. Let us check this. Let u £ U 
satisfying : 

• r i @ u ^ , Pu 

fi = mm{a u + —} = a a + —. 

u&a a a 

First, we can easily check that given by: 

u = a n + ^-, and x = t [0 lid lid ■■■ (n-l)/d], 
d 

is a solution of the system : fj, + x = M u x + c u . 

Second, the feedback strategy s : Xj — > u, 1 < i < n, is optimal, because for all i G {1, 2, • • • , n} and 
for all u € U we have : 

[M u + c n x]i = n + Xi < a u + ^ + Xl = [M u x + c a ] t 



Thus the couple (fi,x) satisfies system (111. □ 



Corollary 3. The fundamental diagram on the circular road where the traffic is described by dynam- 
ics (ffl) is given by : f = min M6W {a u d + fi u }. 



Proof. The average flow is equal to the average speed given in Theorem [5] multiplied by d. □ 
Remarks 

1. We make here a link between the model presented above and the car-following model [211 
Daganzo [7] has already linked the car-following model to his variational theory based 
model. In j^H Qj|] , the traffic is described on one road by assuming that each vehicle follows his 
predecessor without possibility of overtaking and with a stimulation-response relation. Let x n (t) 
denoting the position of the n-th vehicle on the road, at time t, and T denoting the reaction 
time of a driver. The acceleration d 2 x n (t + T)/dt 2 of the n-th vehicle at time t + T is given by 
multiplying by A the response to the stimulation dx n -i(t)/dt — dx n (t)/dt. We write : 

d 2 x n (t + T) _ { dx n -i(t) dx n (t), 

dT 2 dT^ (13) 

where A is often taken as follows: 

\ [dx n (t)/dt] m 



A 



[x n -i(t) - x n (t)] 1 

with Ao a constant and m and I are parameters. In the simple case where m = I = i.e. A = A , 
we obtain the linear model : 

= M[x n -i(t) ~ x n (t)], 

which we can write: 

v = X s + a, (14) 

where s — x n —\ — x n and a is a constant determined by the boundary condition v = cor- 
responding to the jam state s = Sj. The velocities considered in equation (18J) are nothing but 



what is given in ( 14 ) 
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2. Approximating Diagrams using the formula of Corollary [3] is also computing Fenchel transforms 
(concave version). This is known and used in [Tj. Indeed, if we denote by V the set V = 
{a u , u £E U} and define the function g by: 

g : V -> K 

u = a u i-^ -/3 U , 

then we obtain: 

f(d) = mm (dv - g(v)) = g*(d), 

where g* denotes the Fenchel transform of g. Thus, giving an approximation of a diagram 
is giving a finite set V = {a u ,u € U} and defining the function g, which associates for each 
a u ,u a value fi u . Graphically, this is giving a finite set of segments by their slopes a u and 
their values at the origin j3 u . 

3. Using the stochastic optimal control model given above, we obtain a large class of concave 
diagrams, but not all the concave diagrams. Indeed, every concave function f(d) can be approx- 
imated, with any precision, by a function h{d) = min ue u(a u d + j3 u ) with a„£l and j3 u G K, 
for all umU; but in the model, we accept only (3 U satisfying j3 u e [0, 1]. 

4. The min-plus linear model is a particular case where U — {111,1*2} with (ai,/?i) = (v,0) and 
{0L2, P2) = {— c, 1)- In this case, the approximation is a piecewise linear function with two 
segments. 



4 Stochastic game model 

We extend again the stochastic dynamic programming model to obtain a stochastic game one. We 
assumed in the preceding sections that in both low and high density cases, the drivers have superior 
bounds of speed to respect (< inequalities), and they maximize their speed by moving with the 
minimum superior bound. The extension is to suppose also the dual situation. Indeed, in the case 
of high densities, the drivers can have inferior bounds of speed to respect (> inequalities), and then 
minimize their speed by moving with the maximum inferior bound. This is detailed below. With this 
extension, the car dynamics are interpreted in term of stochastic games, and the fundamental traffic 
diagram is obtained, as above, by solving analytically a generalized eigenvalue problem. Moreover, 
even non concave diagrams can be approximated with this extension. 

Let us first give a short review on stochastic games. A stochastic game problem in infinite horizon 
with undiscounted costs is written: 

minmax \ seS E /lirn^ ^ ^ cf k w " \ (15) 

I ~~* °° k=0 ) 

where (x k )k^m is a controlled Markov chain with a finite set of states X = {1, 2, • • • , n}, u k £ U is the 
minimizer decision variable taken at time k, with IA a finite set of controls, w k € W is the maximizer 

k k 

decision variable taken at time k, with W a finite set of controls, c u k w € K is the cost to pay at time 
k being in x k and when the minimizer takes the decisions u k and the maximizer takes the decision w k , 
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and S is the set of control strategies, that is the set of time-indexed sequences in U x W (a strategy 
s £ S is a fixed sequence {(u k ,w k )}k£N, u h £l4,w k £ W). 

If we denote by M uw ,u £U,w £ W, the transition matrix of the controlled Markov chain associ- 
ated to the controls u £ U and w £ W, then the stochastic dynamic programming equation associated 



to problem ( 15 ) (where the maximizer knows, at each step, the choice of the minimizer) is written: 



\i + v x = min max{[M uw v] x + c^ w }, V 1 < x < n. (16) 



In ( 16 1, [i can be seen as an additive eigenvalue of an operator h : K n 3 v h{v) £ R™ defined by: 



h x (v) = min max.{[M uw v\ x + c u x w } V 1 < x < n. (17) 
The operator h is additive 1-homogeneous and monotone. Corollary [2] can be applied again. 

4.1 The model 

Here we extend the model by taking into account the driver's behavior changing from low densities 
to high ones. The difference between these two situations is that in low densities, drivers, moving, or 
being able to move with high velocities, they try to leave large safe distances between each other, so 
the safe distances are maximized; while in high densities, drivers, moving, or having to move with low 
velocities, they try to leave small safe distances between each other in order to avoid jams, so they 
minimize safe distances. To illustrate this idea, let us denote by y k (resp. z k ) the travelled distance 
up to time k by a given car (resp. by the car ahead). Instead of maintaining the safe distance more 
than <j i.e. y k+1 < z k — a , let's use the constraint: 

y k+1 < max{z fe - a, (y k + z k )/2} . 

In a low density situation where the vehicles are separated by at least 2a we have : 

max{z fe - (j, (y k + z k )/2} = z k - a , 

while in a high density situation we obtain: 

max{z fc - a, (/ + z k )/2} = (/ + z k )/2 . 

In this latter case, we accept the vehicles moving closer but by reducing the approach speed in order 
to avoid collisions. The whole dynamics will be : 

y k+1 = min{max{z fc - a, (y k + z k )/2}, y k + v} . 

In general, we denote by x k (resp. x k +1 ) the distance travelled by a car i (resp. by the car ahead) up 
to time k. We obtain the following dynamics : 

^ k+1 _ I min ueW max u , eW {(l - P uw )x k + (3 uw x k +1 + a uw } si i < n , 

1 min„ eW max li , eW {(l - /3 uw )x k + (5 uw x\ + a uw + n/3 uw /d} si i = n , 
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As in Section [3j we define the matrices M uw , (u,w) € {U x W) and the vectors c uw ,(u, w) e 
(U x W) by: 

ri-A*, p u ••• 

1 $uw ftuw 



AT 





l-B 



System ( 18 1 is written: 



.T fc+i = minmax-ffAr™:^ + d" }, 1< « < n. (19) 
1 ueuwew 



System ( 19 1 is a dynamic programming equation associated to a stochastic game problem. Let us 



denote by h the operator giving the dynamics (IT9|, i.e. h : K n — ► 



Ma; fc ) = min max{ [M^a^L + c™}, 1 < i < n . 
ueu mew 

It is easy to see that h is an additive 1-homogeneous and monotone operator. We can also prove, by 
using similar arguments as in Proposition [l] that the graph Q(h) is strongly connected if and only if 
there exists u in U and w € W such that /3 uu; 7^ (i.e. /3 ut0 G (0, 1]). Then, taking this assumption, 
we apply Corollary [2] and conclude that the system : 

u + Xi = min max {(M™i), + c™ } , 1 < i < n. (20) 

admits a solution (p, x) where x is defined up to an additive constant, not necessarily in a unique way, 
and /1 is unique and satisfies: 

/i = lim — x^, 1 < i < n . 

fc->+oo k 

fi is interpreted as the average car speed. 



Theorem 6. A solution (fJ,,x) of equation (20) is given by 



u = min max{a u -I — ^} and cc = '[0 1/d 2/d ••• (n — l)/d\. 

uCU w€W a 

Proof. Using the same arguments as in the proof of Theorem [5] let (u, w) <E U x W satisfying: 

fi = mm max{a„ H — } = a U w H — , 

ueu wew a a 

and let s € S be the feedback strategy given by (M 1 ™, c fitu ), that is : 

s : — > (u, w), 1 < i < n, 

The couple (/^, a;) given by : 

M = + and cc = *[0 1/d 2/d ••• (n-l)/d], 
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is solution of : 

fi + x = M^'x + c<™ . 

The strategy s is optimal because for all i in {1, 2, • • • , n}, for all u in IA and all w in W we have : 

[M aw x + c u % = a + Xi = min max{a„ + — } + ccj = min max\M uw x + c uw ]i, 

u&a view d u&a wew 



Hence the couple (/x, x) satisfies the spectral equation (20). □ 
Corollary 4. The fundamental diagram on a circular road where the traffic is described by the dy- 



19) is given by : f — min uSW max we w{a uw d + 



Proof. Similarily, the average flow is equal to the average speed given in Theorem [6] mutiplied by the 
average density d. □ 

5 Examples 

5.1 Approximation of fundamental traffic diagrams 

On Figure [3] we take an example of a fundamental diagram obtained experimentally based on real 
measurements made on a stretch of three lanes of the French highway A6. We give an approximation 
of this diagram using the stochastic game model. 



flow (veh/min) 



Measure of the section A6AW0.09 



iii.. 



occupancy rate (%) 



10 20 30 40 50 60 70 



Figure 3: The fundamental diagram observed on the A6. 



On the x-axis of Figure [3] we have the car occupancy rate on the road, which is a normalized 
density. On the y-axis we have the car flow given by the number of cars per minute. To obtain a 
normalized diagram where the density and the flow of vehicles are given by relative quantities in a 
coordinate system without unities, we normalized the flow. To do this, we set arbitrarily to 1 the free 
speed, which is the average speed of vehicles in very low densities. This quantity is given by the slope of 



12 



the fundamental diagram at the origin. Assuming that the maximum possible car flow corresponds to 
the full density of vehicles moving freely (with the free speed), we obtain the flow scale. For example 
if we take d = 0.1 as a very low density, then from Figure [3j the flow corresponding to d — 10% is 60 
veh./min., then we get a maximum flow of 600 veh./min (witch corrsponds to d — 100%). Then by 
dividing the y-axis by 600, we obtain a normalized diagram. 

The objective here is to approximate the diagram of Figure [3j in order interpret it and understand 
the traffic phases. To be able to approximate non concave parts of the diagram, we use the stochas- 
tic game approximation. Basing on Corollary |4j we propose the following approximation (with six 
segments) : 

/ = min {d, 0.27d + 0.07, -0.19d + 0.18, max{-0.25d + 0.2, -0.2d + 0.17, 0}} , 
which is shown on Figure |4j 



40/3 
10 



f (%) 












non concave 






































d (%) 



10 22 40 60 75 85 100 



Figure 4: Stochastic game approximation. 



5.2 Traffic simulation and transitory regimes 

Let us take U — {iti, 112, 113}, with (ai, = (1, 0), (02, P2) = (1/3, 1/8), and (a 3 ,/3 3 ) = ( — 1, 1). The 
fundamental traffic diagram derived using the stochastic optimal control model is / = mm{d, (l/3)d+ 
1/8, 1 — d}. The diagram presents three phases. On Figures |5| Figure [6] and Figure [7j we simulate 
the traffic phases (phase 1: f(d) — d, phase 2: f(d) = 1/'M+ 1/8, and phase 3: f(d) = 1 — d). The 
car positions on the circular ring are given at three different times in order to highlight the transitory 
regime. 

We note that during phase 1 and phase 3, where /3i = and /3 3 = 1, the asymptotic car distributions 
on the road are not necessarily uniform, as shown on Figure [5] and Figure [7j However, during phase 2 
where P2 = 1/8 G (0,1), the asymptotic car distribution on the road is uniform, as obtained on 
Figure [6j 

In general, and for the three models presented above, we observed numerically the following : 

• For densities corresponding to the first segment of the fundamental diagram (the segment start- 
ing with the point (0, 0)), which are in an interval of type [0, do], the asymptotic car distribution 
on the road can be non uniform. 
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• If the last segment of the fundamental diagram (the segment ending with (1,0)) is given by 
f(d) = 1 — d (the only case corresponding to f3 a = 1), then for the corresponding densities, 
which are in an interval of type [d\ , 1] , the asymptotic car distribution on the road can be non 
uniform. 

• For all other densities [do,di], the car distribution on the road converges to the uniform distri- 
bution. 




Time: 1/100 Time: 7/100 Time: 100/100 



Figure 5: Phase 1. 




Time: 1/150 Time: 20 /150 Time: 150/150 



Figure 6: Phase 2. 




Time: 1/150 Time: 10/150 Time: 150/150 



Figure 7: Phase 3. 



General remarks 

• For the three models given in this article, the constraints /3 U € [0, 1], Vw € 14 (or (3 UW G [0, 1], Vu € 
U,Vw £ W) put the fundamental traffic diagram in the triangle [(0, 0), (1, 0), (0, 1)] (triangle 
ABD on Figure |8b. Thus, the fundamental diagram lives on only one half of the surface on 
witch it can a priori live, which is the rectangle [(0, 0), (1, 0), (1, 1), (0, 1)] (rectangle ABCD 
on Figure [8]). This can be written: \/d £ [0,1], /(d) < 1 — d. Indeed, if we suppose that the 
fundamental diagram passes through a point p = (d, f(d)) satisfying f(d) > 1 — d, then we can 
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A 1/2 d 1 B 

Figure 8: The fundamental diagram lives on the triangle ABD. 



easily check that with segments a u d + /3 u (or a uw d + /3 UW ) satisfying j3 u £ [0, 1] (or /3 UW <E [0, 1]), 
we can never reach any point p' = (d',f(d')) satisfying d! > d and f(d') < 1 — d! . Thus, the 
point B = (1, 0) is never reached. This is absurd. 

• Finally, let us note that although the models given in this article have stochastic interpretations, 
they are deterministic models. A dual approach of the min-plus modeling given here is presented 
in [35] , with an extension to a stochastic model. The extension assumes that the desired speed is 
stochastic and lives in a set of two reals. In this case, the average speed is given by a Lyapunov 
exponent of a stochastic min-plus matrix [21 I25j . In |10j , Petri net and min-plus based models 
for the derivation of fundamental diagrams of 2D-traffic are presented. 

6 Conclusion 

The models presented in this article describe ID-traffic by dynamic programming equations associated 
to optimal control problems. By solving analytically these equations, we derived explicitly the fun- 
damental traffic diagrams. The derivation permits the approximation of a large class of fundamental 
diagrams. Moreover, the parameters used in the models are basic traffic variables such as the desired 
velocity of drivers, or the safety distance between successive cars. This allows us to give simple inter- 
pretations of the traffic phases appearing on experimental fundamental diagrams obtained from real 
measurements. 
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